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Abstract 

We present a new formulation of monotonically convergent algorithms 
which allows to optimize both the control duration and the field fluence. 
A standard algorithm designs a control field of fixed duration which both 
brings the system close to the target state and minimizes its fluence, 
whereas here we include in addition the optimization of the duration in 
the cost functional. We apply this new algorithm to the control of spin 
systems in Nuclear Magnetic Resonance. We show how to implement 
CNOT gates in systems of two and four coupled spins. 



Q-i' 1 Introduction 



The optimal control of quantum systems is a long-standing goal [II [21 [^ which 
remains very attractive both from a practical and a fundamental point of views 
r~^ . [H [3 [S] • By finding the optimal balance between the minimization of the dis- 

CO ' tance to the target state and the minimization of the energy of the control field, 

CO , the optimal solution allows to bring the system close to the target state while 

avoiding parasitic phenomena due to a too large fluence. In this context, the 
CO . control duration is also a crucial parameter which has to be taken into account 

^^ ' in the optimization process. For instance, a too long duration could be problem- 

atic if other concurrent physical or chemical processes with the same time scale 
occur during the control. This question is particularly interesting in quantum 
computing where coherence has to be preserved [7]. Since a control field cannot 
k> ' generally fully compensate the dissipation effects [8], a too long interaction of 

^ , the system with the environment can destroy its coherence and the quantum 

superposition or the entanglement produced by the control. 

Solving time-optimal control problems remains however a challenging task. 
One way is to use the Pontryagin maximum principle and geometric optimal 
control theory [5". 10]. However, such techniques can only be applied for the 
moment to small dimensional quantum problems with very few energy levels 
[TTl [T^ [T^ [TH I15j . On the other hand, monotonically convergent algorithms 
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are an efficient way to solve optimal control problems and have been widely used 
in the control of chemical and physical processes since the pioneering papers by 
Tannor et al. [TB] and Rabitz et al. [T7] which were based on the work of Krotov 
[TS] . This approach can be applied to very different and large quantum systems 
(See e.g. [ini 1201 IHl 1121 HSI) and to a variety of non-standard situations such 
as the nonlinear interaction between the system and the control field ^M US] 
or to take into account spectral constraints on the optimal solution [221 1^ . 
Up to now, however, these algorithms have generally been used with a cost 
penalizing the field fluence and a fixed control duration. By construction of 
these algorithms, a formulation in terms of a time-optimal control, i.e. with 
a duration which is not fixed, is a very difficult question since these methods 
imply the backward propagation of the adjoint state from the final time of the 
control. A first possibility to reduce the time of control consists of penalizing the 
intensity of the control field in a neighborhood of the final time. However, this 
technique strongly depends on the penalization, and requires adjustments that 
have to be done by the operator [22] • A time-optimal or free time optimal control 
algorithm was proposed in |2H], but this method differs from our approach in 
the sense that a second Lagrange multiplier on the control duration (in addition 
of the adjoint state) is added. This leads to a more complicated algorithm than 
the one proposed below. 

We present in this paper a new formulation of monotonically convergent 
algorithms with a cost penalizing both the field fluence and the control duration, 
which allows us to find the best compromise between these two parameters. 
Using a rescaling of time, we first rewrite the optimal equations on a fixed 
time interval independent on the control duration T, which appears as a new 
parameter in the time-dependent Schrodinger equation. We then consider a 
monotonic iterative algorithm whose each step is decomposed into two substeps 
consisting in an optimization of the energy of the field with T fixed and an 
optimization of the time T with a fixed control field. The first substep is done 
by a standard monotonically convergent algorithm, while a gradient or another 
discrete optimization procedure is used for the second substep. We impose that 
each substep increases the cost functional leading thus to a monotonic algorithm. 
This algorithm is described in a very general way and can therefore be applied 
to any problem of quantum control. 

To test the efficiency of this approach, we consider the control of spin systems 
|29| ■ and in particular the implementation of quantum gates in such systems. 
Different technologies have been developed so far to exploit the powerful of 
quantum computing. One of the most promising solution is Nuclear Magnetic 
Resonance (NMR) [301 ■ The control technology developed over the past fifty 
years allows the use of sophisticated control fields and permits the implementa- 
tion of complex quantum algorithms such as the Deutsch-Jozsa and the Grover 
ones [HI]. NMR is therefore an ideal testbed to experiment new ideas in quan- 
tum control. In this paper, we show how to implement two and four qubits 
CNOT gates. These different numerical computations allow to extract the main 
properties of our algorithm and to highlight the differences with respect to a 
standard approach. 

The paper is organized as follows. In Sec. |21 we describe the new monoton- 
ically algorithm for pure state quantum systems. The proof of its monotonic 
character is established. Section|3]is devoted to the application of this approach 
in a two and four spin systems in order to implement, in optimized time, CNOT 



gates. We conclude in Sec. S) 



2 Time-optimal control algorithms 

We present in this section the algorithm in a general setting for pure quan- 
tum states. The formalism can be straightforwardly extended to mixed-state 
quantum systems [20] or to the control of evolution operators [32J. It is this 
latter generalization that will be used in Sec. [3] for the implementation of quan- 
tum gates. We consider the maximization of the projection onto a target state, 
but the algorithm could be equivalently defined for maximizing the expectation 
value of a given observable. 

2.1 Methodology 

Let \(f>o) and \(f>f) be the initial and target states of the dynamics. We consider 
the time-optimal control problem of maximization of the cost functional Jt{Et) 
over the control duration T and the control field Et- Note that the subscript T 
is added in this paper to any quantity depending upon this time. The functional 
Jt is defined by 

Jt{Et) = 25ft[(V'T(r)|V/)] -a [ El{t)dt (1) 

where a is a positive parameter which weights the relative importance of the 
energy of the control field with respect to the projection onto the target state. 
5R[-] is the real part of a complex number. The state |-0t(O) of the system 
satisfies the time-dependent Schrodinger equation which is written in units such 
that h=l: 

*^|V'tW) = (ffo + ST(i)i?l)|^T(<)) (2) 

with as initial condition |'(/)t(0)) = |(/)o)- The Hamiltonian Hq is the field-free 
Hamiltonian and the operator Hi describes the interaction between the system 
and the control field, which is assumed to be linear. 

The first step of the method is to define a fixed time interval, for instance 
[0,1]. We consider for that purpose the time rescaling s — t/T. Introducing 
\i};{s)) = IVtIs • T)) and E{s) = Et{s ■ T), we obtain from Eq. (HD that 

z^l^(s)) = T(i?o + E{s)Hi)\i:{s)) (3) 

with the initial condition |V'(0)) = \4'o)- The cost functional is also changed by 
the time rescaling and becomes 



J{E) = 2»[(V'(1)|V'/)] ~aT ( E^{s)ds. 

Jo 



(4) 



The new optimal control problem consists now in maximizing the cost functional 
J with respect to the control field E and the time T which plays here the role 
of a parameter. The control duration is fixed to 1. 



2.2 Monotonically algorithm 

The algorithm is decomposed into two substeps. We alternatively optimize 
the functional J with respect to the control field _E by a standard monotonic 
algorithm and with respect to the duration T by a discrete procedure such as a 
gradient method. We prove that the cost increases at each step of the algorithm. 

Optimization of the control field. We consider the triplets {\'ip{t)), E{t),T) 

and {\ilj{t)),E{t),T) corresponding to the initial and final states of this substep 
of the algorithm. The variation of the cost is given by: 

A J = J{E) - J{E) 

= 25R[(Vi(l) - ^{l)Hf)] -aT [ (E'^is) - E^{s)ds. 

Jo 

We introduce the adjoint state |x(i)) which satisfies 

^^\x(.s))=TiH„+Eis)H^)\xis)} (5) 

OS 

with the final condition |x(l)} ~ \4'f)- We then have 

5R[(^(i) - vxi)i0/)] = mm - ^(i)ix(i))] (6) 

which can be transformed into 

5R[(^(1) - ^(l)|</>/)] = K[^ dsK^xl^ - V-) + {x\§-^{^ - ^))]] . (7) 
Using Eqs. ([3]) and ([SJ, one deduces that 



5R[(V'(l)-^(l)|0/)] = 2r3[/ ds{x\ii^{E - E)\^)\. (8) 

Jo 

One finally arrives to 

AJ^aT [ ds{E - E){E + E- -3[(x|i?i|V')]). (9) 

Jo " 

Knowing E{s), the choice E = ^[{x\Hi\ip)]/a ensures that A J > for this 
substep. This part of the algorithm can be summarized as follows. Starting 
from the quadruplet {\^p{s)),\xis))^ E(s),T), we construct the quadruplet of 
the next sub-iteration by propagating backward the adjoint state |x(s)) from 
\(pf) with the field E{s). We then propagate forward the state |f/'(s)} from 
00 ) with the field E{s) which is computed at the same time by the relation 
E{s)^mxis)\H,\i>is))]/a. 

Optimization of the control duration. At this stage of the algorithm, we 
consider the triplets (|-0(s)}, £'(s),T) and {\ip{s)},E{s),f). We recall that the 
state \iIj{s)) satisfies 

i^-jm) = T{Ho + Eis)H,ms)). (10) 



We compute the variation of the cost functional A J which is equal to: 

AJ = 2K[(?/'(1) - ^(1)|V^/)] - a{f -T) f E'\s)ds. (11) 



Introducing the adjoint state |x(s)) whose dynamics is governed by Eq. ([5]), one 
obtains after similar computations as for the previous case that 

AJ = a{T -f) f dsE{s){~-^[{x\HS)] + E{s)). (12) 

Jo a. 

The parameter T has to be chosen such that AJ > 0. A solution consists in 
using a gradient method by noting that 



VtJ =-a f dsE{s){-mx\^im + E{s)). 
Jo " 



(13) 



We define the new time T from the preceding one as: 

f = r-rVTJ(s(s),r), (14) 

where r is a small real parameter. We choose numerically r small enough to 
ensure the monotonicity of the cost functional. The computation of the optimal 
value of r requires however several new propagations to determine the cost J 
since the evolution of j?/;) (needed to calculate (?/'(l)|V'/)) depends on the value 
of T (see Eq. ([TO)) ). Other methods ensuring the monotonic behavior of the 
cost can be used for this substep as the following procedure. In this approach, 
we define the new duration Tk as a function of the old duration T^ as follows: 

ffc = (1 + a)Tk 

where a is a small positive or negative parameter. Practically, we can choose e.g. 
a = ±10"'^, but this value can also be adjusted during the computation. This 
leads to two new costs J^J" and J^ . The final time at step k is the time associated 
to the maximum value between J^ , J^ and J^ . This method has the advantage 
over the gradient approach to limit at each step the number of propagations of 
Eq. Q to 2. This point can be interesting when very heavy computations are 
considered. This systematic procedure has been used in the numerical examples 
of Sec. [21 In particular cases, we have checked that the gradient and this 
systematic approach give equivalent results. Note that a faster algorithm can 
be designed by not following a strict alternation between the two optimization 
procedures. In other words, this means that the control field can be optimized 
several times between each optimization of the time parameter. However, such 
a method requires adjustments and a more involved study which are out the 
scope of this paper. 

3 Control of spins systems 

3.1 Description of the model 

The principles of control in NMR are detailed in different books and review 
articles. Here we only give a brief account needed to introduce the model used 



[29| . We consider the control of a system of coupled spins by different magnetic 
fields acting as local controls on each spin. This means that each field only 
controls one spin and does not interact with the others, i.e. the spins are 
assumed to be selectively addressable. This hypothesis has also the advantage 
to render the system completely controllable. Similar models have been used 
in numerical studies analyzing the realization of quantum algorithms in NMR 
(see, e.g., Ref. [55]). 

We introduce a system of n coupled spins whose evolution is described by 
the following Hamiltonian: 

n 

H = Hq + 2_^{UjxHjx + UjyHjy), 

the couplings being given by: 

Ujx — <Jjx, -tljy — Gjy 

where the operators {ajx, <Jjy) are Pauli matrices which only act on the j'th- 
spin. We assume that the free evolution Hamiltonian Hq is associated to the 
topology of a chain of coupled spins with only nearest-neighbor interactions. 
The corresponding Hamiltonian is given by: 

n-l 
Hq = '^(yjz 8)a-j+i; z, 

where the approximation is valid in heteronuclear spin systems if the coupling 
strength between the spins is small with respect to the frequency shifts [29] . 
The coupling parameter between the spins is taken to be uniform and equal 
to 1. The different equations being linear, other couplings could be considered 
from a standard rescaling of the time and of the amplitude of the control fields. 
Note that the algorithm could also be used with different couplings between the 
spins. 

3.2 Optimal implementation of a CNOT gate 

Our goal is to apply the time-optimal control algorithm to implement a C"^~^NOT 
gate (ControUed-Not) in a system of n qubits with n = 2 or 4. A C^~^NOT 
gate is a gate in which the target qubit flips if and only if the {n — 1) control 
qubits are equal to 1. For n = 2, the CNOT transformation is represented by 
the unitary operator Ucnot which can be written as: 



UcNOT 
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The logical states involved in a C^'^^^NOT gate can be mapped onto the spin 
states in different ways. A straightforward and natural way used in this paper 
is to encode the first qubit in the first spin, the second qubit in the second spin, 
and so on if more than two spins are considered. 



To implement quantum gates, we formulate the control problem in terms 
of evolution operators U{t). This means that the objective of the control is to 
reach the target state Ucnot, while optimizing the control duration and the 
energy of the fields. The time-optimal monotonically convergent algorithm for 
evolution operators can be sketched along the same way as for the wave function 
case of Sec. [51 This algorithm can be obtained by replacing the wave function 
V'T(i)) by UT{t). The corresponding cost functional is given by: 

J{E) = 2?R[Tt[UcnotUt{T)]] -a f El{t)dt. (15) 

The evolution operator UT{t) satisfies the Schrodinger equation 
.dUrit) 



dt 



= {Ha + ET{t)Hi)UTit) (16) 



and the scalar product {ip{t)\x{t)) is replaced by Tr[[/|F] where V{t) is the 
adjoint propagator. Note that, in this case, 2" fields are simultaneously op- 
timized. The efficiency of the process is measured by the projection P — 

^n[Tl[UcNOTUT{T)]\. 

From a numerical point of view, two different parameters, ao and Eo{t), 
have to be adjusted when using this algorithm. These parameters do not play 
the same role since a is a parameter characteristic of the algorithm, while Eq (t) 
is the initial field (the same for all the fields) used to initiate the optimization 
process. More precisely, we assume that the parameter a depends on time and 
can be written as a{t) — ao sin {iit/T) where ao is a constant. This switching 
function is introduced to provide a smooth on and off switch of the field [M] . In 
order to not enforce the algorithm to follow a given pathway, we consider that 
the initial trial field EqII) is zero over a given duration Tq. The dependance of 
the final solution on the two parameters Tg and ao will be analyzed in Sec. 13.31 

3.3 Numerical results 

We first analyze the computational results for a system of two spins. Figure 
[T] displays the optimal solution computed by the algorithm for the values of 
parameters Tq = 0.5 and ao — 0.08. The parameter a which describes the 
evolution of the control duration at each step of the algorithm is taken to be 
5 X 10"''. Other values of a have been used leading either to worse results or to 
a slower convergence of the algorithm. As can be seen in Fig. [TJ the evolution 
of the optimal control fields and of the probability is rather smooth with no 
rapid oscillation. A very good efficiency larger than 0.99 has been reached in 
5000 iterations with a final duration of the order of T = 2.035. Note that a 
standard monotonically algorithm with this total duration leads to a solution 
very close to the ones obtained with this new algorithm. More precisely, for 
the standard algorithm, we have obtained a projection P larger than 0.999 for 
a control duration such that 1.9 < T < 2.4. This computation shows that 
the time-optimal control algorithm has found the best compromise between the 
duration, the minimization of the distance to the target state and the energy 
of the field. As could be expected, the modification of the control duration 
slows down the convergence of the algorithm since a projection larger than 0.99 
is obtained respectively after 2512 and 700 iterations for the new and standard 




Figure 1: Optimization of the CNOT gate: Evolution of the probabiUty P 
(top) and of the corresponding optimal fields acting on the first or second spin 
(bottom). Numerical values are taken to be aa = 0.08 and Tq ~ 0.5. The final 
probability is P = 0.9964. 



methods, respectively. The monotonic behavior of the algorithm can be checked 
in Fig. [Altogether with the evolution of the duration Tk. As for the cost Jk, one 
sees that this parameter presents a rapid increase for the first 3000 iterations 
and then an approximatively constant behavior. A crucial property that this 
algorithm must satisfy (at least locally) is the independence of the final solution 
with respect to the value of Tq, i.e. of the starting guess used to initiate the 
algorithm. This point is illustrated in Fig. [3] where two attraction points for 
the sequence (Tk) have been found when the time Tq varies. We numerically 
determine the two basins of attraction and we found a boundary of the order of 
Tq ~ 0.75. Other attraction points exist for larger initial values of the control 
duration Tq which are not represented in Fig. [3] Note that this attraction point 
characterizes not only the final control duration but also the final control fields 
and the final probability density as can been checked in Fig. [31 We also see in 
this figure that a better efficiency is reached for Tq — 0.9 with a longer and lower 
energetic optimal solution. This point stresses the role of the control duration 
in the accuracy of the computation. 

In Fig. [H we study the evolution of the final time Tf and of the probability 
density P as a function of the parameter ap. We observe that P increases and 
Tf decreases as the parameter ao decreases. As could be expected, the smaller 
ao is, the more energetic the optimal solution is since ao controls the relative 
weight of the pulse energy in the cost J. With a more energetic optimal solution, 
the algorithm can find an optimal solution with a lower duration and a better 
efficiency. 

We extend these numerical results to the case of a four-spin system and 
a C^NOT gate. Due to the complexity of this gate, a larger duration and a 
larger number of iterations are required to reach a sufficient efficiency. The 
parameter a is taken to be 5 x 10""*. As for the two-spin case, we find two 
possible optimal solutions according to the value of Tq which are displayed in 
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Figure 2: Optimization of the CNOT gate: Evolution of the cost Jk (dashed 
Hne) and of the time Tk (sohd Hue) as a function of the number of iterations 
k of the algorithm. The same parameters (ao and Tq) ^^ ii^ Fig- HI have been 
used. 
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Figure 3: Optimization of the CNOT gate: (top) Evolution of the time Tk 
for different initial times Tq as a function of the number k of iterations. For 
Tq < 0.7, the algorithm converges towards the same optimal duration close to 
the value 2. The parameter ao is taken to be 0.08. (bottom) Same as before 
but for the probability density P. A better efficiency is reached for To = 0.9. 
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Figure 4: Optimization of the CNOT gate: Evolution of Tf (open circle) and 
P (cross) as a function of the parameter ao for To = 0.5. The solid and dashed 
lines are just to guide the lecture. 
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Figure 5: Optimization of the C'^NOT gate: (top- middle) Evolution of the 
probability density P and of the control duration Tk as a function of the number 
of iterations for different initial durations Tq. (bottom) Time-evolution of the 
probability density P for the different optimal solutions. The parameter ao is 
taken to be ao = 0.01. 

Fig. [5] The time evolution of the probability density shows that the structure 
of these two solutions is very similar even if the two final durations are different. 



4 Conclusion and perspectives 

This work deals with the time-optimal control of spin systems in NMR. We 
propose a monotonically convergent algorithm which both optimizes the control 
duration and the energy of the field. We show that the change of the duration at 
each iteration of the algorithm leads to a more flexible algorithm and thus allows 
a better convergence with respect to a standard version of such algorithms. This 
method has the advantage of simplicity and general applicability whatever the 
quantum optimal control problem considered. We have finally demonstrated 
the possibility of implementing quantum gates from the control fields computed 
by this algorithm. Since there exists no unique optimal solution, we have shown 
that we can select the control fields by changing the initial duration of the 
control. 
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